Adaptive Multimodal Fusion in Radiology: Dynamic Balancing of Visual Findings and Clinical Context
This paper proposes a Neural Gated Fusion architecture that dynamically balances visual chest X-ray data and clinical text using an adapted Gated Multimodal Unit, demonstrating superior performance in detecting thoracic pathologies—particularly those with subtle visual evidence—compared to static fusion and unimodal approaches on a clinically diverse MIMIC-CXR subset.